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[57] ABSTRACT 

A pipelined image processor generates an image of the 
information contained on first and second portions of a 
document. The pipelined image processor includes a 
first pipe for processing information contained on the 
first portion of the document, and second pipe for pro- 
cessing information contained on the second portion of 
the document. The pipes receive the output from two 
camera assemblies which are used for generating an 
electrical signal in response to information contained on 
the document, an image digitizer for generating digi- 
tized information from the electrical signal by the 
means for generating an electrical signal. In addition, 
both pipes also include a resequencer for generating 
resequenced information from the digitized informa- 
tion, as well as an image processor for generating pro- 
cessed information from the resequenced information. 
Finally, the first and second pipes include a transposer/- 
compressor assembly for generating transposed and 
compressed information from the processed informa- 
tion, and a compressed data buffer for storing the trans- 
posed and compressed information. 

5 Claims, 7 Drawing Sheets 
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ment. Additionally, these individuals physically cor- 

PARALLEL PIPELINED IMAGE PROCESSOR reeled incorrectly read MICR data associated with 

each of the sorted documents. 

This is a continuation of U.S. patent application Ser. These prior techniques of utilizing a plurality of indi- 

No. 419,528, filed Oct. 10, 1989, now abandoned. 5 viduals to process financial documents have proved to 

CROSS REFERENCE TO RELATED te relatively costly and inefficient, in that many of these 

APPLICATIONS documents have been lost or destroyed during their 

physical handling by the aforementioned individuals, 

This application is related to the following appiica- the speed associated with the processing of the 

tions, which were filed of even date herewith and io documents is limited to that associated with the process- 

which are assigned to the same assignee as this appiica- mg capabilities of the individuals and the mechanical 

tion: . . amount entry equipment they use. 

IMAGE DATA PROCESSOR— Klein et al. U.S. J H Y 7 

Ser. No. 419,270 filed Oct. 10, 1989; SUMMARY OF THE INVENTION 

■aE^^ 15 According t0 * c prcfcrrcd cmbodifficnt of *■ pres - 

SagIdATA-^ fo^tSnVa^ 

filed Oct. 10, 1989 and now U.S. Pat No. SSSKEEiS 'S^^T^ 

5 093 871 issued Mar 3 1992- second portions of the document The pipe- 

ucTunn*AMn appabatttc cop crccrr ™ lined image processor comprises a first pipe for process- 

M m™^ 20 * - f °r T ^ ? the of 

TA-Klein et al. U.S. Ser. No. 419,595 filed Oct. document, and second pipe for processing ^formation 

10, 1989 and now U.S. Pat. No. 5,029,226 issued confined on the second portion of the document Each 

Jul 2 1991- of the pipes receives the output from means for generat- 

METHOD AND APPARATUS FOR SCALING 25 mg m c,ectrical in response to information con- 

IMAGE DATA— Klein et al. U.S. Ser. No. tained on the document, and each of the pipes include 

420,779 filed Oct. 10, 1989; means for generating digitized information from the 

METHOD AND APPARATUS FOR DETECT- electrical signal. In addition, both pipes also include 

ING DOCUMENT SIZE IN AN IMAGING means for generating resequenced information from the 

SYSTEM— D'Aoust et al. U.S. Ser. No. 419,530 30 digitized information, as well as means for generating 

filed Oct, 10, 1989 and now U.S. Pat. No. 5,020,124 processed information from the resequenced informa- 

issued May 28, 1991; tion. Finally, the first and second pipes include means 

APPARATUS FOR IMAGE DATA TRANSPO- for generating transposed and compressed information 

SITION AND COMPRESSION/ DECOM- from the processed information, and means for storing 

PRESSION— Klein et al. U.S. Ser. No. 419,523 35 the transposed and compressed information. 

kSSS^mU* ?at ' N °' 5,055,919 BRIEF DESCRIPTION OF THE DRAWINGS 

METHOD AND APPARATUS FOR TRANS- For a more complete understanding of the present 

POSING IMAGE DATA— D'Aoust et al. U.S. . invention, relative to the advantages thereof, reference 

Ser. No. 419,778 filed Dec. 10, 1989 and now U.S. ^ may be made to the following detailed description taken 

Pat. No. 5,048,104 issued Sept. 10, 1991; in conjunction with the accompanying drawings in 

METHOD AND APPARATUS FOR LOSSLESS which: 

COMPRESSION AND DECOMPRESSION OF FIG. 1 is a block diagram of a typical document 

IMAGE DATA— Klein et al. U.S. Ser. No. sorting system utilizing the parallel pipelined image 

419,61 1 filed Dec. 10, 1989 and now U.S. Pat. No. 45 processing system of the preferred embodiment of this 

5,095,374 issued Mar. 10, 1992; DIAGNOSTIC invention; 

SYSTEM FOR A PARALLEL PIPELINED FIG. 2 is a block diagram of the parallel pipelined 

IMAGE PROCESSING SYSTEM — D'Aoust et im age processing system shown generally in FIG. 1; 

al. U.S. Ser. No. 419,606 filed Dec. 10, 1989 and FIG. 3 is a block diagram of an image digitizer shown 

now U.S. Pat No. 5,007,100 issued Apr. 9, 1991 ^ generally in FIG. 2; 

BACKGROUND OF THE INVENTION ~ FIG 4 is a block diagram of the resequencer shown 

generally in FIG. 2; 

Field of the Invention pjQ. 5 is a block diagram of the image processor 

This invention relates generally to image processing shown generally in FIG. 2; 

and more particularly to a method and apparatus for the 55 FIG. 6 is a block diagram of the transposer/compres- 

parallel pipelined processing of acquired financial docu- sor assembly shown generally in FIG. 2; 

ment image data. FIG- 7 is a block diagram of the compressed data 

buffer shown generally in FIG. 2; and 

Discussion F jq g ^ a block diagram of the diagnostic transport 

Financial documents, such as checks or drafts, usu- 60 interface shown generally in FIG. 2. 

a|ly contain a magnetic ink character recognition DETAILED DESCRIPTION 
(MICR) codehne which is typically read by a sorter and 

which automatically sorts these documents into a plu- Referring now to FIG. 1, there is shown a financial 

rality of bins. Prior to sorting, in current practice, these document sorting system lo having a typical document 

sorted documents are presented to banking personnel 65 sorter 12, which in the preferred embodiment of this 

who physically handle the documents and mechanically invention, comprises a model DPI 800 sorter which is 

enter the dollar amount associated therewith upon each manufactured by the UNISYS Corporation of Blue 

document by the use of specialized amount entry equip- Bell, Pennsylvania. 
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Sorter 12 contains a track 14 into which a plurality of pressed data buffers 64 and 66, a back camera assembly 
financial documents 16 traverse through and reside 68, a front camera assembly 70, a diagnostic transport 
within, and further containing a magnetic character interface 72, and a communications processor 74. 
reader 18 and magnetic strip character controller 20. Power source 44 is coupled to entities 46-74 by bus 
Additionally, sorter 12 contains a document holder 22 5 78 to provide electrical power thereto. Back camera 
and the pipelined image processor 24 arranged in accor- assembly 68 is coupled to the input of image digitizer 50 
dance with the teachings of the preferred embodiment by signals on bus 80 while also coupled to the diagnostic 
of this invention. transport interface 72 by signals on bus 82. Front cam- 
Controller 20 is coupled to the reader 18 by signals on era assembly 70 is coupled to the input of the image 
the bus 26, to a host computer 28 by signals on the bus 10 digitizer 48 by signals on bus 84 while being coupled to 
30, and to the pipelined image processor 24 by signals the diagnostic transport interface 72 by signals on bus 
on the bus 32. The computer 28 is coupled to an image 86. The optical sensor assembly 46 is coupled to the 
storage module 34 by signals on the bus 36, and the diagnostic transport interface 72 by signals on bus 88. 
image storage module 34 is also coupled to the pipelined Entities 48-62 are coupled to the diagnostic transport 
image processor 24 and to a plurality of workstations 38 15 interface 72 by signal on bus 90 while the diagnostic 
by signals on the buses 40 and 42, respectively. transport interface 72 is additionally coupled to commu- 
In operation, documents 16 sequentially traverse by ni cations interface 74 by signals on bus 92. Additionally, 
reader 18 which reads a typical code appearing upon the diagnostic transport interface 72 is coupled to the 
the usual MICR codeline strip which is normally placed magnetic reader controller 20 of sorter 12 by signals on 
upon each of the documents 16. This code is then sent to 20 bus 32. 

the computer 28 by signals on the bus 30 for storage The output of image digitizer 48 is coupled to the 

therein and to the processor 24 by signals on the bus 32. input of resequencer 52 by signals on bus 94 while the 

As each of the documents 16 further travel within the output of the resequencer 52 is coupled to the input of 

track 14, they pass in close proximity to processor 24 image processor 56 by signals on bus 96. The output of 

which creates an image thereof and sends this processed 25 the image processor 56 is coupled to the input of tran- 

image, by signals on bus 40, to the image storage mod- sposer/compressor assembly 60 by signals on bus 98 

ule 34 for storage therein. After passing by the proces- while the output of the transposer/compressor assem- 

sor 24, each of the documents are then sorted, by sorter bly 60 is coupled to the compressed data buffer 64 by 

12, in the usual way (based upon the contents of the signals on bus 100. The output of the compressed data 

MICR codeline) and are held within the document 30 buffer 64 is coupled to communications processor 74 by 

holder 22. signals on bus 102. 

After a typical block of the documents 16 has been The output of the image digitizer 50 is coupled to the 

sorted in the aforementioned manner, the workstations input of the resequencer 54 by signals on bus 104 while 

38, by signals on the bus 42, sequentially request the the output of the resequencer 54 is coupled to the input 

aforementioned document imaqes from the storage 35 of the image processor 58 by signals on bus 106. The 

module 34. These images are then downloaded to the output of the image processor 58 is coupled to the input 

workstations 38, by use of signals on the bus 42, along of the transposer/compressor assembly 62 by signals on 

with their associated magnetic code data obtained from bus 108 while the output of the transposer/compressor 

host computer 28. assembly 62 is coupled to the input of the compressed 

After these images are captured by the workstation ,40 data buffer 66 by signals on bus 110. The coram unica- 
38, individual operators electronically enter the dollar tions processor 74 is coupled to the image storage mod- 
amount associated with each document and electroni- ule by bus 40. The output of the compressed data buffer 
cally resolve an difficulties associated with the reading 66 is coupled to the Communications processor by sig- 
of the MICR code. Each image's dollar amount and nals on bus 112. 

associated corrections then form a single record which 45 It should, at this point, be noted that in the preferred 
is then sent to the storage module 34, by use of signals embodiment of this invention, entities 48, 52, 56, 60, and 
on the bus 42, where it may be later accessed for use in 64 represent a single document image pipelined process- 
automatically placing the dollar amount and correc- ing assembly or a "pipe" associated with the acquired 
tions upon the sorted documents. Therefore, the afore- image of the front of one of the plurality of documents 
mentioned document sorting system 10 substantially 50 16. The back of that same document 16 has another 
eliminates the physical handling of the plurality of doc- document image pipelined processing assembly or a 
uments 16 when the associated dollar amount is placed "pipe" associated with it and that is defined by entities 
thereon thusly increasing the efficiency and timeliness 50, 54, 58, 62 and 66. 

of the overall document sorting system 10. In operation, the plurality of documents 16 traverse 

Referring now to FIG. 2, there is shown parallel 55 track 14 thereby sequentially passing by photo detector 

pipelined image processor system 24 arranged in accor- sensing assembly 46. Typically, there is a window of 

dance with the principles of this invention and con- time between the exiting of one of the pi urality of docu- 

tained within the document sorting system 10 as shown ments 16 from the light path 114 defined by sensor 

in FIG. 1. assembly 46 and the entering of another one of the 

Specifically, parallel pipelined image processing sys- 60 plurality of documents 16 within the same path 114. 

tern 24 contains a power source 44 and a typical photo This inter-document time gap therefore also relates to a 

diode sensing assembly 46 which is positioned on oppo- defined window of time in which parallel pipelined 

site sides of the track 14 thereby sensing the presence of image processing system 24 performs diagnostic testing 

one of the plurality of documents 16, as the document without degrading the efficiency of the document sort- 

16 passes along track 14. Parallel pipelined image pro- 65 ing system 10 shown generally in FIG. 1. 

cessing system 24 further contains image digitizers 48 As each of the plurality of documents 16 passes 

and 50, resequences 52 and 54, image processors 56 and through sensor assembly 46, a signal is generated on bus 

58, transposer/compressor assemblies 60 and 62, com- 88 to the diagnostic transport interface 72 informing the 
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interface that a document 16 is on its Way to camera The vertical strips of image data associated with the 
assemblies 68 and 70. Before that same document ar- front of the document 16 are sequentially input into the 
rives at the camera assemblies 68 and 70, the diagnostic image digitizer 48 by signals on bus 84 which emanate 
transport interface 72 sends a signal on the bus 90 to from front camera assembly 70. The data on bus 84 is 
enable image digitizers 48 and 50. To halt the diagnostic 5 organized into the aforementioned eight segments of 
testing of system 24, interface 72 then sends another data with each segment having its even and odd pixels 
signal on bus 90 activating the leading edge of the edge placed upon separate buses. The image digitizer 48 then 
detection assembly of the resequences 52 and 54, to be sequentially mixes and digitizes all of the received 
later explained. Additionally, when the signal on bus 88 image strips and passes the eight segments of digitized 
indicates that the document has exited the sensing as- 10 image data associated with each of the vertical image 
sembly 46, then diagnostic transport interface 72 issues strips to the resequencer 52 by signals on the bus 94. 
a signal on bus 90 to the resequencers 52 and 54 acti vat- The resequencer 52 then receives the eight segments of 
ing the trailing edge of the edge detection assembly. . digital data appearing on the bus 94 and by combining 
After a delay suitable to ensure that the document 16 pixels from adjacent segments, creates separate ex- 
has cleared both camera assemblies 68 and 70, interface IS panded parallel processing channels. Each segment is 
72 issues another signal on bus 90 to image digitizers 48 expanded into a channel to allow image processing 
and 50 to initiate diagnostic testing of the parallel pipe- operations to be performed in the image processor 56 
lined image processing system 10. Prior to this point, without causing discontinuities at segment boundaries, 
the document 16 had passed through reader 18 and has These parallel image channels are then placed upon the 
had its MICR codeline read by reader 18, of FIG. 1, and 20 bus 96 and input into the image processor 56. The image 
has been assigned a document identification code by processor 56 then processes these separate channels of 
sorter 12. The magnetic code and document identifies- image data in parallel. This parallel processing of the 
tion code are then sent to interface 72, by signals on bus image data allows the pipelined image processing sys- 
32, by controller 20. tern 24 to work in a very efficient and timely manner. 

After one of the plurality of documents 16 has passed 25 The processed image data is then output from the image 

the sensor assembly 46, it is placed by track 14 between processor 56 in parallel channels onto bus 98 to the 

camera assemblies 68 and 70. Each of the camera assem- transposer/compressor assembly 60. In one embodi- 

blies 68 and. 70, in one embodiment of this invention, are ment of this invention, the image processor 56 utilizes 

comprised of a charge coupled photo diode array manu- the processing techniques of normalization, background 

factured by the EG and G Reticon Corporation which 30 suppression, spot/void filtering, and scaling to the data . 

is located at 345 Potrero Avenue, Sunnyvale, California present upon the bus 96. 

94086-4197 and which is referred to as model number The transposer/compressor assembly 60 then reor- 
RL1288D. Camera assemblies 68 and 70 further contain ders the processed image data that was associated with 
a plurality of lamps for illuminating the document 16 the vertical strips (columns) of the front of the docu- 
and a plurality of lenses coupled to the photo diode 35 ment 16 into horizontal strips (rows) by a transposition 
array. The charged coupled photo diodes within assem- process. The transposition process increases the effi- 
blies 68 and 72 each capture the image of a vertical strip ciency of the subsequent compression process by reduc- 
associated with the document 16. The strip has a width ing the number of pixels whose values cannot be cor- 
of approximately .005 inches. As the document 16 rectly predicted because of discontinuities at the leading 
passes entirely through the path of camera assemblies 69 40 and trailing edge of the acquired image and at channel 
and 70, a plurality of these vertical strips of image data boundaries associated therewith. The amount of reduc- 
es generated by each of the assemblies 68 and 70 and are tion, of these pixels, is approximately: 
serially and respectively passed to the image digitizers 

48 and 50. reduction factor Number of rows within the image 

Each of these camera assemblies 68 and 70 typically 45 p rTOUCUOD «w Number of columns with the image 
produce this aforementioned vertical strip in a sequence 

of eight separate segments which represent images asso- The transposition process also reduces the overall size 

ciated with the entire vertical dimension of the docu- of the compressed image by placing the edge disconti- 

ment 16. The charge coupled devices within assemblies nuities associated therewith, further apart. This reduc- 

68 and 70 are typically segmented in order to allow 50 tion in overall size has been found to be very significant 

rapid shifting of analog image data out of the devices. It in a substantially white image. 

should also be noted that, in one embodiment of this The data in the horizontal strips are then compressed, 
invention, the front camera assembly 70 produces an and this compressed data is sent to the compressed data 
image of document 1$ which results from a scan begin- buffer 64 by placing these parallel channels of data on 
ning at the bottom of the document 16 to the top thereof 55 the bus 100. The compressed data buffer 64 then re- 
progressing from right to left. However, the back cam- ceives these parallel channels of compressed data and 
era assembly 68 produces an image of the backside of rearranges them into one large block for transfer to the 
the same document 16 by scanning from the top of the processor 74 by signals on bus 102 and thereafter to the 
document 16 to the bottom thereof while progressing image storage module 34 by signals on bus 40. Once this 
from left to right. The following discussion will be 60 block of compressed data is received, the image storage 
related to the parallel image processing pipeline associ- module 34 may store the data therein or may altern- 
ated with the front camera assembly and containing tively place the compressed data on the bus 42 for corn- 
entities 48, 52, 56, 60 and 64 therein. It should, however, munications to the work stations 38 (FIG. 1). The com- 
be realized by one of ordinary skill in the art that the munications interface may be one of a plurality of types 
following discussion is equally applicable to the parallel 65 including those associated with fiber optic or coaxial 
pipelined image data system associated with back cam- cable media. 

era assembly 68 and containing entities 50, 54, 58, 62 and Each of the entities 48, 52, 56, 60 and 64 will now be 

66 therein. explained in greater detail. Additionally, the use of the 
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previously defined inter-document time gap for the stantially similar to the signal on bus 140. Assembly 130 
performance of a diagnostic test upon the pipelined also produces a synchronization signal on lead 146 
assembly 24 will also be described herein. which is activated to mark the last pixel output from 

Referring now to FIG. 3, there are shown details of buffer 126 onto bus 94, and further produces a data 
the image digitizer 48 of FIG. 1. In the preferred em- 5 output ready signal on lead 145 which represents a 
bodiment of this invention, digitizer 48 comprises eight clock pulse for every analog to digital conversion of 
individual pixel summers 116(a-h), eight low impe- each of the pixels associated with signals on the bus 134, 
dance buffers 118(a-A), eight analog to digital convert- which are subsequently latched into buffer 126. 
ers 120(a-A), eight parity generators 122(a-A), a multi- Bus 84 has an additional signal on line 150 thereon 
plexer 124, an output buffer 126, a diagnostic RAM 128, 10 which emanates from camera assembly 70 (FIG. 2) and 
and a timing logic assembly 130. which typically represents the physical placement of 

Each segment of the image data associated with a camera assembly 70 in either the front Or the back of 
vertical image slice of the front of document 16 has an document 16. Signal 150 is input into the diagnostic 
associated pixel summer 116(a-/r), a low impedance transport interface 72 by means of bus 90 (FIG. 2) and 
buffer amplifier 118(a-A), an analog to digital converter 15 which stores the signal 150 and which uses the same for 
120(a-h), and a parity generator 122(a-A) associated later control of the resequencer 52 (FIG. 2). The diag- 
therewith. The following discussion details the inter- nostic transport interface 72 is further coupled to the 
connection and use of entities 116(a), 118(a), 120(a), and diagnostic RAM 128 by signals on bus 152 and is also 
122(a) with the eighth physical and hierarchically high- coupled to the multiplexer 124 by signals o bus 154. 
est segment hereinafter referred to as the "seventh seg- 20 Diagnostic RAM 128 is coupled to the multiplexer 124 
ment" since these segments are usually identified by a by signals on bus 156. 

number from zero to seven. It should be realized by one The diagnostic RAM 128 comprises, in one embodi- 
ed ordinary skill in the art that the following discussion ment, a 32K X 8 bit static random access memory assem- 
is equally applicable to the other eight segments of the bly, having associated address generation and control 
output of camera assembly 68 and to the other seven 25 assemblies which allow the diagnostic transport inter- 
segments generated by camera assembly 70 (FIG. 2) as face 72 to sequentially write data thereto by means of 
well. bus 152 and which allows RAM 128 to transmit con- 

Tbe seventh segment of image data acquired by cam- tained data to multiplexer 124, by signals on bus 156. 
era assembly 70 (FIG. 2) is placed onto the bus 84 as Parity generator 122(a) generates standard parity 
analog data and is input into the pixel summer 116(a). 30 codes associated with the digital data received by sig- 
Since the image data associated with the seventh seg- nals on bus 136 and inputs the received digital data and 
ment of document 14 is segregated into a plurality of parity into multiplexer 124 by signal on bus 158. During 
even and odd pixels by camera assembly 70, the pixel normal image data processing associated with docu- 
summer 116(a) mixes these even and odd pixels such ment 16, multiplexer 124 is directed to output signals 
that it produces an analog output signal on bus 132 35 present on input bus 158 to output buffer 126 through 
which represents an ordered arrangement of the image the use of signal on bus 160. The directive emanates 
pixels in time, according to their physical location from the diagnostic transport interface 72 by signals on 
within the seventh segment. The analog output signal bus 154. 

on bus 132 is then input into the low impedance buffer Upon receipt of the data represented by signals on 
amplifier 118(a) by signals on bus 132. The low impe-' 40 bus 160, the output buffer 126 stores the same and subse- 
dance buffer amplifier 118(a) is necessary in order to quently outputs this segmented digital data on to bus 94 
allow the analog to digital converter 120(a) to operate which is input into the resequencer 52 of FIG. 4. 
in an accurate manner. The output of the low impe- The diagnostic RAM 128 is typically preloaded with 
dance buffer amplifier 118(a) is then input to the analog a standard test pattern by the diagnostic transport inter- 
to digital converter 120(a) by signals on bus 134. The 45 face 72 through bus 152. During the aforementioned 
analog to digital converter 120(a) then digitizes these inter-document time gaps associated with the traversal 
analog pixels and places the resulting digitized data onto of documents 16 along the track 14 (FIG. 1), the diag- 
bus 136 which is input into parity generator 122(a). nostic transport interface 72 will normally cause the 

It should be realized at this point that there are two diagnostic RAM 128 to transmit this test pattern to 
additional signals associated with synchronization of 50 multiplexer 124 by the use of bus 156. Diagnostic trans- 
data on bus 84. The first signal represents an end-of-scan port interface 72 causes this downloading of testing 
signal on lead 138, which is typically produced by cam- information to multiplexer 124 by the use of a control 
era assembly 70 (FIG. 2) as a complete single vertical signal on bus 154 after receiving signals on bus 88 from 
scan of the document 16 is output from assembly 70 sensor assembly 46 (FIG. 1) reforming interface unit 72 
onto bus 84. End-of-scan signal on lead 138, is input 55 that a document 16 is not present at the camera assem- 
from bus 84 and thereafter to the timing logic assembly bly 70. Additionally, the diagnostic transport interface 
130. The second signal is a clock signal on lead 140 72 causes the multiplexer 124 to output the testing data 
which is used to identify the individual pixels. It is pro- represented by the signals on bus 156 to its output bus 
duced by the camera assembly 70 and is output upon the 160 by use of a control signal on bus 154 thereto. This 
bus 84. The clock signal on lead 140 is input to the 60 will result in bus 160 carrying identical test data for 
timing logic assembly 130. every one of the eight channel segments. This testing 

Timing logic assembly 130 then produces an output data is then placed into the output buffer 126 and is 
signal on bus 142 which is input into each of the analog subsequently transmitted to the resequencer 52 (FIG. 2) 
to digital converters I20(a-h) and which enables con- in a manner previously alluded to for the digital data, by 
verters 120(a-A) to digitize the incoming pixels repre- 65 the use of the bus 94. It should be noted that signals 146 
sented by signals on the bus 134. Timing logic assembly and 148 and the signals on bus 154 are also placed onto 
130 is further coupled to the diagnostic RAM 128 by the bus 94 for transmission to the resequencer 52 (FIG. 
signals on bus 144 which represent a clock that is sub- 2). 
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Referring now to FIG. 4, resequencer 52 is shown as associated therewith because less image data relating to 

containing a buffer write control assembly 170, a con- the track background is associated with the obtained 

trol register 172, an edge detection assembly 174, a document image. 

channel compare assembly 176, a buffer read sequencer Additionally, the end-of-scan signal on lead 146 

assembly 178, eight segment input registers 180(a-A), 5 (FIG. 3) and the signal on bus 154 which were placed 

eight overscan buffers 182(a-A), eight segment buffers upon bus 94 within the image digitizer 48 (FIG. 3) are 

184(a-A), eight underscan buffers 186(a-A), eight output input into the control register 172 and are subsequently 

registers 188(o-A), and a plurality of multiplexers 189. placed onto bus 202 such that they are input into buffers 

Signals on bus 94 are coupled to the control register 182(o-A), 184(a-A), and 186(a-A). They are subse- 

172, input registers 180(a-/r), and buffer write control 10 quently output therefrom by signals on bus 200 and are 

assembly 170. coupled to the buffer read sequencer assembly 178. 

The output of the channel compare assembly 176 is The buffer read sequencer 178 is a sequential state 

placed onto bus 190 and is coupled to the diagnostic machine that controls the unloading of buffers 182(o-A), 

transport interface 72. The diagnostic transport inter- 184(a-A), and 186(<i-A) in a manner that will augment 

face 72 is also coupled by signals on bus 192 to each of 15 the segment video data on bus 202, by adding a number 

the plurality of multiplexers 189 and is further ooupled of pixels of overscan and underscan thereby forming a 

by signals on bus 194 to the buffer read sequencer as- processing channel. 

sembly 178 and by signals on bus 196 to the edge detec- When the buffer write control 170 has finished writ- 
tion assembly 174. Each of the outputs associated with ing an entire segment of video data to buffers 182(a-A), 
output registers 188(a-A) are coupled to the bus 198 20 184(a-A), and 186(a-A), it signals the buffer read se- 
which is further coupled to the channel compare assem- quencer 178, over bus 200, that this task has been com- 
bly 176 and to the input of each of the multiplexers 189. pleted. Upon receipt of this completion signal, se- 
The output of both the buffer write control assembly quencer 178, in one embodiment, allows approximately 
170 and an output of the buffer read sequencer 178 are ten pixels of data to be output from underscan buffers 
coupled to each of the buffers 182(a-A), 184(o-A), and 25 186(a), then allows approximately 128 pixels of data to 
186(a-A) by signals on bus 200. Additionally, registers be output from buffer 184(a) and then allows approxi- 
172 and 180(<2-A) are coupled to buffers 182(orA), mately ten pixels of data to be output from the buffer 
184(fl-/»), 186(tf-A) write control assembly 170, channel 182(a). This process continues in parallel for each chan- 
compare assembly 176 and to edge detection assembly nel of data, until the aforementioned data has been out- 
174 by signals on bus 202. The inputs of registers 30 put. from buffers 182(6-A), 184(6-A) and l&6(b-h) in a 
188(o-A) are coupled to registers 182(a-A), 184(a-A), similar manner. Following this data output sequence, 
and 186(a-A) by signals on bus 204. The output of edge the end-of-scan signal 208 is output, onto bus 96, by 
detection assembly 174, buffer read sequence assembly sequencer 178, such that its output coincides, in time, 
178, and multiplexers 189 are coupled to bus 96 and are with the last pixel output from buffer 182(A) after it 
transmitted to the image processor 56. 35 passes through register 188(A) and one of the multiplex- 
In operation, digital image data represented by each ers 189 onto bus 96. Sequencer 178 activates the test 
of the individual segments associated with camera as- signal on bus 210 if the signal on bus 154 is coupled to 
sembly 70 (FIG. 1) (which were placed upon bus 94 by bus 200. 

digitizer 48 of FIG. 2 are input into One of the input Buffer read sequencer. 178 also checks to make sure 

registers 180(a-A). * 40 that signals 146 and 148, originating on digitizer 48 

Video signals enter the edge detection assembly 174 (FIG. 1) are simultaneously available from buffers 

by bus 202. Assembly 174 detects the leading and trail- 182(a-A), 184(a-A), 186(c-A) since they were simulta- 

ing edges of each of the documents 16 whose image is neously input thereto by signals on bus 202. If a loss of 

obtained by camera assembly 70 (FIG. 2). The diagnos- synchronization is detected, a fault is reported to the 

tic transport interface 72 enables the detector assembly 45 diagnostic transport interface 72 by signals on bus 194. 

174 and loads threshold data to it by means of signals on Read sequencer 178 outputs data from buffers 

bus 196 and enables detection assembly 174 to look for 182(a-A), 184(a-/r), and 186(a-A) at a rate sufficiently 

the leading edge of the document 16. high in order to ensure that buffers 182(a-/r), 184(a-A), 

This threshold value is compared with the obtained and 186{a-A) will never overflow. In one embodiment, 

video data by assembly 174 in order to see if the differ- 50 the rate of video data flow into buffers 182(a-A), 

ence between the sum of the pixel gray-scale values in 184(o-A), and 186(a-A) is approximately 64 million pix- 

the current video scan and the sum of the pixel gray- els per second. That is, eight pixels are presented, one 

scale values in the sixteenth previous vertical scan is per input register 180(a-A), approximately every 125 

greater than this loaded threshold value. A document nanoseconds. The output rate of buffers 182(a-A), 

present signal 206 is then transmitted by assembly 174, 55 184(o-A), 186(a-A), and 188(a-A) is approximately 80 

on bus 96, if a leading edge is detected, in this manner, million pixels per second. That is, eight pixels are pres- 

in any of the channels. After activating signal 206, as- ented, one per channel, at the output of each of the 

sembly 174 must continue to monitor document 16 in registers 188(a-A) approximately every 100 nanosec- 

order to recognize its trailing edge. That is, signal 206 is onds. 

deactivated, by assembly 174, if a trailing edge of the 60 Within the resequencer 52, each of the input registers 

same document 16 is detected in a similar manner on at i80(/i-//) is uniquely associated with an overscan buffer 

least two of the segments. 182(o-A), a segment buffer 184(a-A), and an underscan 

Using the incoming video data, upon bus 202, is im- buffer 186(fl-A). The following discussion will center on 

portant to detect an edge, because it has been found that the operation of the input register 180(a) associated 

the edge of the document 16 can be found more accu- 65 with the seventh segment of data received from camera 

rately than by using sensor assembly 46 of FIG. 2 to do assembly 70 (FIG. 2) that was digitized by the digitizer 

the same. This increased accuracy translates into a re- 48 (FIG. 2). It should be noted by one of ordinary skill 

duced size of the subsequent compressed image data in the art that this discussion will be substantially the 
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same for the other input registers 180(o-A) associated scan portions and at the bottom of the underscan por- 
with other segments of the camera assembly 70. tion), however, any image artifacts produced by them 

Specifically, input register 180(a) transmits the digital are restricted to the overscan and underscan region of 
image data to its associated segment buffer 184(a). The the segment channel, provided that the overscan and 
storage of this transmitted digital data from input regis- 5 underscan portions are sufficiently deep. After image 
ter 180(a) is controlled by signals on bus ZOO from the processing upon the segment channel has been corn- 
buffer write control 170 in response to signals on bus 94. pleted, the resulting overscan and underscan pixels are 
That is, signals on bus 200 enable the segment buffer stripped off leaving only the processed segment data 
184(a) to receive and store the digital data contained intact. 

within input register 180(a). The segment buffer 184(a) 10 Since channel compare assembly 176 is coupled to 
stores an entire segment of video data. Additionally, the the bus 198, during the period of inter-document time 
underscan buffer 186(a), uniquely associated with the gaps, the testing signal on bus 154 (FIG. 3) which was 
input register 180(a), is made to contain approximately previously placed onto bus 94 is used to enable assembly 
the last 10 pixels of data which were originally stored 176 to accept all of the outputs of registers 188(a-A) so 
within the input register 180(6) associated with the 15 that these outputs may be compared and the results of 
segment which is hierarchically placed one segment this comparison may be placed upon the bus 190 to the 
below the seventh segment (i.e., the sixth segment). diagnostic transport interface 72. Such testing may 
Underscan buffer 186(a) is enabled by a signal on bus allow a user of pipelined processing arrangement 24 to 
200 to accept the digital data which is stored in input periodically determine if the resequencer 52 is opera- 
register 180(a) associated with the sixth segment of the 20 tionally sound. Additionally, diagnostic transport inter- 
video image. Additionally, the overscan buffer 182(a) face unit 72, by the use of signals on bus 192, may cause 
associated with input register 180(a) of the seventh the outputs of each of the registers 188(a-A) to be reo- 
segment would normally be made to accept approxi- rientated before they are sent to image processor 56 
mately the first 10 pixels of data from the input register (FIG. 2) in order to reflect the physical placement of 
associated with a segment of the video image which is 25 the individual camera 70 (FIG. 2). That is, if signal 150 
placed hierarchically above that. However, since input (FIG. 3) reflected a rear camera placement, then diag- 
register 180(a) which is associated with the seventh nostic interface unit 72 would issue a command on bus 
segment of the image is hierarchically superior to all 192 to the plurality of multiplexers 192 to reverse the 
other input registers 180(o-A), its associated overscan register outputs on bus 198 to reflect the relative scan- 
buffer 182(a) is made to contain 10 pixels of zero data. 30 ning motion of the camera with respect to the rear of 
The same is true with the underscan buffer 186(A) asso- the scanned document 16. If signal 150 represented a 
ciated with input register 180(A) which itself is associ- frontal position of camera assembly 70 then diagnostic 
ated with segment number zero of the video image transport interface 72, by means of a signal on bus 192, 
produced by camera assembly 70 (FIG. 2), which is would allow the plurality of multiplexers 189 to pass the 
hierarchically inferior to all other produced segments. 35 outputs of registers 188(a-A) to the bus 96 in a normal or 
The data contents of the associated buffers 182(a), non-inverted sequence. That is, the reorientation associ- 
184(a), and 186(a), which are uniquely associated with ated with the back camera will cause the multiplexer 
input registers 180(a), are then sequentially clocked 189 which normally outputted data of the seventh seg- 
onto bus 204 and placed into output register 188(a). ment to now output data of the zero segment (i.e. seg- 
Output register 188(a) is associated with the seventh 40 ment number "0") and data associated with the sixth 
segment of the image obtained from camera assembly 70 segment would be outputted to a multiplexer 189 associ- 
(FIG. 2). Under the co-ordination of the buffer read ated with the first segment, and so on. 
sequencer 178, the buffer 186(a) is first emptied fol- Because the rate at which scans of the document 16 
lowed by buffer 184(a) then the buffer 182(a). There- are made is directly proportional to the speed that the 
fore, the cooperation of registers 180(a) and 188(a) with 45 document 16 travels through track 14 (FIG. 2), a docu- 
buffers 182(a), 184(a) and 186(a), provides for a single ment image processor 24 which processes images from 
unique processing channel associated with the seventh documents 16 having a slower track speed would not 
segment of the camera assembly 70. Each of the other have as many image processing channels as it would if 
segments associated with the camera assembly 70 are the document 16 were traveling faster through track 
simultaneously expanded into similar unique channels 50 14. 

and all of these unique channels are individually placed In one embodiment then, the diagnostic transport 
upon the bus 198 and thereafter into a unique one of the interface 72 directs the sequencer 178, by signals on bus 
plurality of multiplexers 189. 194, to create four channels of data (instead of eight) 

For the following discussions, a channel of data is from the eight segments of video data. In this operation, 
considered to be a sequential string of pixels consisting 55 the sequencer 178 performs as before except two seg- 
of underscan pixels, segment pixels, and overscan pixels. menu of data are placed between a single overscan and 
The eight channels of pixel data are constructed simul-' underscan buffer 182(a-A) and 186(a-A) respectively 
taneously by the aforementioned action of read se- and data is output to only four of the eight registers 
quencer 178. The formation of channels from the seg- 188(a-A). For example, the hierarchically highest chan- 
ment data is essential to the operation of parallel pipe- 60 nel would contain approximately ten underscan pixels 
lined image processor 24. That is, image processing from the top of the data normally contained within the 
operations which are functions of pixels within a region, fifth segment and contained in underscan buffer 186(a) 
must process the acquired image including the disconti- followed by the data normally contained within the 
nuities at the edges of each of the segments thereof. sixth segment register 184(6), followed by the data con- 
Adding underscan and overscan pixels, to each seg- 65 tained within the seventh segment register 184(a), and 
ment, allows the image processing operations to process followed by approximately ten overscan pixels of data 
these added pixels as well. Discontinuities still exist at normally contained within register 182(a). Another 
the boundary of the channel (i.e. at the top of the over- embodiment of this invention allows for only two chan- 
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nels, each containing four segments of data, while oper- lated by all processors 240 and 242, from all the chan- 
ating in a substantially similar fashion. nels, must be the same. The diagnostic transport inter- 

Referring now to FIG. 5, there is shown further de- face 72 verifies this as a measure of the integrity of 
tails of the image processor 56 of FIG. 2 associated with assembly 56. 

pipelined image processing system 24 and containing 5 In the preferred embodiment of this invention, the 
pixel normalization processors 220 and 222, background diagnostic transport interface may activate any or all of 
suppression processors 224 and 226, maximum/- the processors 220, 228, 224, 232, 236, or 240 relative to 
minimum value accumulator processors 228 and 230, the channel of data they are operating upon, by enabling 
spot/void filtering processors 232 and 234, scaling pro- signals on bus 250. Additionally, any or all of the pro- 
cessors 236 and 238, size detection processors 240 and 10 cessors 222, 230, 226, 234, 238, and 242 may Deactivated 
242, an interrupt generator 246, and a channel compare relative to the channel of video data they are operating 
and parity test assembly 248. on. The only constraint is that the channels within sys- 

Specifically, normalization processors 220 and 222, tern 56 must be configured in the same way in order to 
along with assembly 248 are coupled to signals on bus prevent visible discontinuities or artifacts in the image 
96, while processors 220, 222, 224, 226, 228, 230, 232, 15 and to allow correct operation of the channel compari- 
234, 236, 238, 240 and 242 are coupled to the diagnostic son logic for diagnostics. 

transport interface unit 72 by signals on bus 250. Addi- Assembly 248 is used in conjunction with the diag- 
tionally, the output of assembly 248 is coupled to the nostic test data emanating from the diagnostic RAM 
diagnostic transport interface 72 by signals on bus 252. 128 (FIG. 3) which is transmitted through signals on 
Processor 220 is coupled to assembly 248, processor 20 bus 94 and then through the resequencer 52 (FIG. 2) 
224, and to processor 228 by signals on bus 254, while until it is passed to image processing system 56 by bus 
processor 228 coupled to assembly 248 by signals on bus 96. This diagnostic data is then passed by signals on bus 
256 Processor 224 is coupled to processor 232 and to 96 to the processors 220, 222, 224, 225, 228, 230, 232, 
assembly 248 by signals on bus 258 while processor 232 234, 236, and 238 and the output of these processors 220, 
is coupled to assembly 248 and processor 236 by signals 25 222, 224, 225, 228, 230, 232, 234, 236, and 238 is moni- 
on bus 260. tored bv tne channel compare and parity test assembly 

Processor 222 is coupled to processor 230, processor 248 which is enabled by the testing signal on bus 96 
226, and assembly 248 by signals on bus 262 while pro- which was impressed upon bus 96 (FIG. 2) in the rese- 
cessor 230 is coupled to assembly 248 by signals on bus quencer 52. In the image processing system 56, video 
264 Processor 226 is coupled to processor 234 and 30 information is only periodically tested because transient 
assembly 248 by signals on bus 266 while processor 234 faults in the video should not cause objectionable visible 
is coupled to processor 238 and assembly 248 by signals artifacts. Signals involving the synchronization of the 
on bus 268. Interrupt generator 246 is coupled to the image, such as end-of-scan signal on line 208 (FIG. 4) 
diagnostic transport interface unit 72 by signals on bus and document present signal on line 206 (FIG. 4) can 
270 and is coupled to the output of processors 236 and 35 disrupt the image if subject to a transient failure. These 
238 by bus 98 signals 208 and 206 are therefore always compared and 

In operation, each of the processors 220, 222, 224, checked by assembly 248 and are input thereto by bus 
226, 228, 230, 232, 234, 236, 238, 240, and 242 performs 96. 

image processing functions. Image processor 56 may, in . The document present signal on line 206 (FIG. 4) 
the preferred embodiment of this invention, allow pro- 40 which was placed on bus 96 is also input into the proces- 
cessors 220, 224, 232, and 236 to perform standard nor- sors 220, 222, 224, 226, 228. 230, 232, 234, 236, and 238 
realization, background suppression, filtering, and seal- and is also output therefrom as signals on Imes 272 and 
ing operations. These four processors 220, 224, 232 and 274, respectively, and are input onto bus 98 and to inter- 
236 operate upon a single channel of image data associ- rupt generator 246. Processed video output is also gen- 
ated with the output of a single one of the plurality of 45 erated by processors 220, 224, 232 and 236 and is output 
the multiplexers 189 (FIG. 4). In the same manner, on line 276 to bus 98 while processed video output is 
processors 222, 226, 234, and 238 also perform image also generated by processors 222, 226, 234 and 238 asso- 
processing operations upon a different channel associ- ciated with another channel of data and it is output on 
ated with an output of a different one of the plurality of bus 278. Both signals on buses 276 and 278 are coupled 
multiplexers 189. Accumulator processors 228 and 230 50 to bus 98. Additionally, the end-of-scan signal 208 from 
are simply used to detect the values of the brightest and the buffer read sequencer 178 (FIG. 4) (which was 
darkest pixels occurring in a received document image. placed upon bus 96 in the resequencer 52) is also input 
This value is sent to the diagnostic transport interface into processors 220, 222, 228, 230, 224, 226, 232, 234, 
72 to aid in the diagnostics as a monitor of the dynamic 236, 238, 240 and 242 output therefrom as a signal on 
range characteristics of the digitized image. Drastic 55 lines 280 and 282 which are also coupled to bus 98. 
changes in the dynamic range would imply failure of It has been found that by assigning eight separate 
the camera assembly 70 (FIG. 2) or an analog compo- channels of video image data to be processed indepen- 
nent in the image digitizer 48 (FIG. 2). dently in the manner set forth within image processing 

Size detection processors 240 and 242 are used to system 56, that the acquired image data may be pro- 
provide image size information to interface 72. This 60 cessed in a highly efficient and timely manner resulting 
physical size of the acquired image is used to correctly in a better overall system performance. Additionally, 
display the image after it has been stored by the image interrupt generator 246 generates a standard type inter- 
storage module 34 (FIG. 1). The length is determined rupt to the diagnostic transport interface 72 by signals 
bv counting the number of vertical scans output by on bus 270 when the document present signals on buses 
processors 236 and 238. Although all processing chan- 65 272 and 274 are deactivated indicating to interface unit 
nels operate independently, they all contain, at any 72 that the processing of a document 16 is complete, 
instant of time, image data associated with the same Additionally, the outputs of the compare and parity test 
document 16. Therefore, the document length calcU- assembly 248 are sent by bus 252 to diagnostic interface 
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unit 72 so that the interface unit 72 may register the In the preferred embodiment of this invention, each 
results of the test for later use. Also, at this time, the transposition and compression channel is implemented 
diagnostic transport interface 72 reads all pertinent redundantly for purpose of real time fault detection. In 
information for the processed document image from the entities 300, 308, 316, 324 and 332, transient faults can 
accumulators 228 and 230; image length from the size 5 result in considerable corruption of the displayed im- 
detectors 240 and 242; and image heights in each chan- age. A redundant path composed of entities 302, 310, 
nel from the scaling processors 236 and 238. 318, 326 and 334 and channel compare assembly 344 

The scaling processors 236 and 238 contain accumu- allows these faults to be relatively easily detected dur- 
lators and sequential logic that monitors the highest and ing operations of assembly 60. 
the lowest occurrence of a document image in a chan* 10 In operation, processed image channel data is re- 
nd. The diagnostic transport interface 72 gathers this ceived into transposer buffers 300 and 302 by signals on 
data from all channels when it receives the aforemen- bus 98 (FIG. 2) and is converted from a vertical image 
tioned processing complete interrupt by signals on bus segment to that of a horizontal row in order that the 
270. Interface 72 uses this information to direct the subsequent compression may be more efficient. Each of 
transposer/compressor assembly 60 to begin compres- IS the transposer buffers 300, 302, 304, and 306 comprises 
sion and to accordingly stop compression. In this way, memory and associated sequential control logic that 
background information, occurring above and below strips off the overscan and underscan pixels from the 
the image, is not compressed. By not compressing this incoming data upon bus 98 and stores the processed 
information, a clearer visual display is produced, stor- segmented data in a form that allows it to be accessed at 
age requirements are reduced, and the system 56 oper- 20 a later time. Buffers 300 and 302 output this data onto 
ates more efficiently. . buses 350 and 352 respectively, as a series of pixels 

Referring now to FIG. 6, there is shown details of a comprising rows of the acquired image with the pro- 
transposer/compressor assembly 60 of FIG. 2 having gression proceeding from the lower right hand corner 
transposer buffers 300, 302, 304 and 306, predictors 308, of the image to the lower left hand corner and from the 
310, 312 and 314, reorderers 316, 318, 320 and 322, run 25 bottom of the image to the top. The interface 72 notifies 
length counters 324, 326, 328 and 330, encoders 332, buffers 300 and 302, by signals on bus 378, as to whether 
334, 336 and 338, compare assemblies 340 and 342, the image camera assembly 70 (FIG. 2) scanned the 
channel compare assemblies 344 and 346 and multiplex- document 16 from bottom to top or from top to bottom 
ers 348 and 349. Entities 300, 302, 308, 310, 316, 318, and whether the camera assembly 70 scanned the docu- 
324, 326, 332, 334 and 348 correspond to a single chan- 30 ment 16 from right to left or from left to right so that it 
nel of output data that was placed upon bus 98 by pro- may accordingly output the pixels in the aforemen- 
cesser 56 while the entities 304, 306, 312, 314, 320, 322, tioned manner. 

328, 330, 336, 338, 349, and 346 relate to a second and Buffers 300 and 302 use this received information to 
different channel of data associated with bus 98. There- determine where, in memory, to find the lower right 
fore, the following descriptive discussion will detail the 35 comer of the document image and how to increment 
processing by transposer/compressor assembly 60 of a the memory address in order to output the required 
single channel of output data upon bus 98. It should be sequence of pixels. This feature in conjunction with 
apparent to one of ordinary skill in the art that this multiplexers 189 on resequencer 52 (FIG. 4) provide for 
discussion is equally applicable to the processing associ- a normal presentation of the image of document 16 
ated with a second and other channel of data appearing .40 regardless of the motion of document 16 relative to 
thereon. camera 70 as of scan direction associated therewith. The 

Specifically, transpose buffers 300 and 302 are cou- transposer buffers 300 and 302 do not, in the preferred 
pled to the input of the predictors 308 and 310 and into embodiment of this invention, accept the test images 
the input of channel comparator assembly 344 by signals initiated from diagnostic RAM 128 (FIG. 3), because 
on buses 350 and 352, respectively. The outputs of the 45 assembly 60 has the aforementioned dual redundancy 
predictors 308 and 310 are coupled to the reorderer for all segment channels associated therewith and this 
processors 316 and 318 and to assembly 344 by signals sort of diagnostic testing is not necessary, 
on buses 354 and 356 respectively. The outputs of the Transposer buffers 300 and 302 are substantially al- 
reorderer processors 316 and 318 are coupled to the ways ready to accept image data associated with docu- 
input of run length counters 324 and 326 and to assem- 50 ment 16. Specifically, the diagnostic transport interface 
bly 344 by signals on buses 358 and 360 respectively. 72, by signals on bus 378, initiates the output of data 
The outputs of the run length counters 324 and 326 are from buffers 300 and 302 by specifying the number of 
coupled to assembly 344 and to encoders 332 and 334 by rows of image data buffers 300 and 302 should output 
signals on buses 362 and 364 respectively. The output.of based upon received signals on bus 250 from size detect 
the encoder 332 is coupled to the comparator 344 and to 55 processor 240 (FIG. 5). Interface 72 then writes this 
compare assembly 340 by signals on bus 366 while the information to all buffers 300, 302, 304 and 306. 
output of encoder 334 is coupled to the comparator Buffers 300 and 302 then output these .transposed 
assembly 342 and to comparator 344 by a signal on the rows of image data to predictors 308 and 310, respec- 
bus 368. tively, by means of signals on buses 350 and 35Z Predic- 

The output of the encoder 336 is coupled to the input 60 tors 308 and 310 then are used to predict, for cpmpres- 
of comparator 346 and to assembly 340 by signals on bus sion purposes, the pixels contained within the output of 
370 while the output of the encoder 338 is coupled to the transposed buffers 300 and 302. These differences 
the comparator assembly 342 and to assembly 346 by between pixels and the predicted values, are then input 
signals on bus 372. Additionally, comparator assemblies to reorderers 316 and 318 via signals on buses 354 and 
340 and 342 are' coupled to the diagnostic transport 65 356, respectively, to reorder "high confidence*' and 
interface 72 by signals on bus 374 while encoders 332, "low confidence" prediction values in order to obtain a 
334, 336 and 338 are coupled to the diagnostic transport higher run length. The output of the reorderers 316 and 
interface by signals on bus 376. 318 are input into run length counters 324 and 326 re- 
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spectively, by signals on buses 558 and 360. Counters If the fault is isolated to a particular path in one chan- 

324 and 326 generate run lengths which are input into nel by these diagnostics, then the correctly functioning 

Huffman encoders 332 and 334 by signals on buses 362 path can be selected, by use of bus 383, for output to the 

and 364 in orde,r to obtain encoded compressed data. compressed data buffers 64 and 66 (FIG. 2) by the inter- 

This compressed data is then output, as compressed 5 face 72 by defining the desired output path by signals on 

data on signal bus 366 and 368 as serial bit streams. bus 383 to multiplexer 348 and 349 which are coupled to 

In the preferred embodiment of this invention, com- the output of encoders 332 and 334; and 336 and 338 
parator assembly 344 is continuously used for compari- . respectively. This allows for system 24 to operate cor- 
son purposes in order to ensure the quality of the data recti y until proper servicing is accomplished, 
compression. In general, signals on buses 350 and 352 10 Referring now to FIG. 7, there is shown further de- 
are input into assembly 344 and are compared for errors tails of a compressed data buffer 64 of FIG. 2 having a 
therein as are the outputs of predictors 308 and 310, plurality of serial to parallel converters 400(a-A)» each 
reorderers 316 and 318, counters 324 and 326, and en- of which corresponds to a single channel of video corn- 
coders 332 and 334. These errors are then output to the pressed data associated with trans poser/compressor 
diagnostic transport interface 72 by signals on bus 380. 15 assembly 60 (FIGS. 2 and 6) and output via signals on 
Additionally, cross channel comparison is accom- bus 100. Each of the serial to parallel convenors 
plished by the use of comparison assemblies 340 and - 400(o-/jX has its output coupled to input multiplexer 402 
342. That is, the diagnostic transport interface unit 72, by signals on bus 404. The output of multiplexer 402 is 
by signals on bus 374, will cause the outputs of the input into buffers 406, 408 and 410 by signals on bus 412. 
encoders 332 and 336 to be compared by assembly 340 20 The outputs of buffers 406, 408 and 410 are input into a 
while causing the outputs of encoders 334 and 338 to be packer 414 by signals on bus 416. The output of packer 
compared by assembly 342. The results of these com- 414 is input into buffers 418, 420, 422 and 424 by signal 
parisons are then input into diagnostic transport inter- on bus 426. The output of buffers 418, 420, 422 and 424 
face 72 by signals on bus 374. These cross channel com- is placed upon a signal on bus 102 which is input into the 
parisons are used when diagnostic data from diagnostic 25 communications processor 74. 
RAM 128 (FIG. 3) is sent in the previously defined Generally, in operation, the compressed video data is 
manner through image processor 56 and on to bus 98. input to the plurality of serial to parallel converters 
This diagnostic information is then transferred through 4€0(o-/») each of which is uniquely associated with a 
trans poser/compressor assembly 60 and the results single video data channel. Converters 400(a-A) convert 
compared within comparison assemblies 340 and 342. 30 each of the compressed video channels into a parallel 

Specifically, the cross channel comparators .340 and fashion and then multiplexer 402 operates to place these 
342 are used to provide interface 72 with information channels of data into buffers 406, 408 and 410 for tempo- 
required to isolate faults to one of the two aforemen- rary storage therein. The output of buffers 406, 408 and 
tioned paths comprising a segment channel. The opera- 410 is then sent to a packer 414 which packs the data 
tion of these comparators 340 and 342 is enabled only 35 contained therein to one contiguous block which is 
for diagnostic purposes while documents 16 are not placed within buffers 418, 420, 422 and 424 by signals on 
passing by camera assembly 70 (FIG. 2). The diagnostic bus 426. This block of compressed data is then sent to 
procedure required to isolate a failing path is as follows. the communication processor 74 for later transmittal to 

First, the interface 72 must load the diagnostic RAM storage module 34 (FIG. 1). 
128 (FIG. 3) with a test pattern in the aforementioned 40 Specifically, the operation of converters 400(ff-A) is 
manner. This test pattern must be defined such that it initiated by the reception of a signal on bus 100 from 
simulates the general appearance of document 16. For any one of the assemblies 60 or 62 (FIG. 2). Each con- 
example, the. test pattern must have approximately 16 verter 400(<z-A) converts each group of eight incoming 
scans of black valued pixel data followed by a test se- serial bits, on bus 100, into a byte. After a byte of data 
quence that has sufficient brightness associated there- 45 is accumulated, it is transferred to the bus 412 and the 
with to trigger the document edge detection assembly accumulation of a new byte begins. 
174 (FIG. 4) in the aforementioned manner. This test Input multiplexer 402 scans the outputs of the con- 
sequence must be followed by at least 16 scans of black verters 400(4-/0 in sequence. If any of the converters 
pixel data. 400(fl-A) has a byte available as an output, multiplexer 

The interface 72 then loads the edge detection assem- 50 402 transfers that byte, by signal on bus 404, to the 
bly 174, in the aforementioned manner, and then in- currently used bufTer 406, 408 or 410. 
structs the diagnostic RAM 128 to output its contents Each of these buffers 406, 408 and 410 stores all chan- 
only once in the manner previously specified. In this nels of compressed data associated with one of the doc- 
way, an artificial test document is sent through the uments 16. The data for each channel is written into a 
resequencer 52 and processor 56 (FIG. 2). 55 separate 16K byte partition in the buffer's memory. This 

The interface 72 enables the cross channel compara- has been found to be sufficiently large to prevent the 

tors 340 and 342 by signals on bus 374, and enables the truncation of the compressed data on any channel, 

buffers 300, 302, 304 and 306 by signals on bus 378. Loading of the buffers 406, 408 and 410 ceases upon the 

Because the data is the same on all of the channels, the end of compression associated with assemblies 60 and 
output of the encoders of two different channels (i.e. 60 62 (FIG. 2). 

332 and 336 or 334 and 338) are compared. At this time, the buffers 406, 408 and 410 begin out- 
Previous to initiating this test, the interface 72 may putting their stored compressed image segments to 
have determined through comparator 344 and 346 and packer 414 by signals on bus 416. The three input buff- 
signals on bus 380 that a particular channel was experi- ers 406, 408 and 410 allow for buffering of up to two 
encing faults. By repeatedly running this aforemen- 65 additional images while one is being output to packer 
tioned diagnostic test, it would be possible to isolate the 414. 

fault to one of the paths comprising the channel with As packer 414 forms a contiguous block of data, it 

the aid of the cross channel comparators 340 and 342. sends the data associated with a unique document 16 to 
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each of the buffers 418, 420, 422 and 424. These buffers 
418, 420, 422 and 424 allow for up to three images to be 
packed while one is being read by the communications 
processor 74. If any of the buffers 406, 408, 410, 418, 
420, 422, or 424 are overwritten because of a hardware 5 
fault or because they were not empty when next written 
to, a fault code is sent thereby to communication pro- 
cessor 74. 

Referring now to FIG. 8, there is shown the diagnos- 
tic transport interface 72 as containing a triport random 10 
access memory 430 coupled to a microprocessor 432 by 
signals on bus 434 and coupled to controller 20 (FIG. 1) 
by signals on bus 32 and to communications processor 
74 by signals on bus 92. It should be noted that in this 
discussion, the term "triport" is used to define the acces- 1 5 
sibility of memory 430 by signals on buses 32, 434, and 
92. Control thereby is established by means of a typical 
arbitration scheme contained within memory 430. Mi- 
croprocessor 432 further contains a communication 
interface portion 436 coupled thereto by signals on bus 20 
438. Microprocessor 432 (under stored program con- 
trol) is further coupled to sensor interface 440 by signals 
on bus 442. 

Triport RAM 430 receives a signal on bus 32 from the 
controller 20 associated with the system 10 to uniquely 25 
identify each of the documents whose image has been 
processed and sent to the communications processor 74. 
Microprocessor 432 receives inputs from sensor assem- 
bly 46 by signals on bus 88 indicating periods of inter- 
document time gaps which may be used in the previ- 30 
ously specified manner for a diagnostic testing associ- 
ated with system 24. Communication interface 436 is 
used by the diagnostic transport interface to communi- 
cate with entities 48, 50, 52, 54, 56, 58, 60 and 62 in the 
aforementioned manner such that microprocessor 432 35 
monitors and controls system 24 and monitors the state 
of the diagnostic tests as set forth previously. 

Microprocessor 432 is also coupled to camera assem- 
blies 68 and 70 (FIG. 1) by signals on buses 82 and 86 
respectively in order to control illumination sources 40 
associated therewith. 

While the invention has been described in connection 
with the presently preferred embodiment, the principles 
of the invention are capable of modification and change 
without departing from the spirit of the invention as set 45 
forth in the appended claims. 

What is claimed is: 

1. A pipelined image processor for generating and 
processing data corresponding to an image of first and 
second sides of a document, the first side of the docu- 50 
ment being partitioned into columns each having a plu- 
rality of segments, said pipelined image processor com- 
prising: 

(a) a first pipe for generating and processing informa- 
tion related to the image of said first side of said 55 
document, said first pipe including: 
a first camera assembly for generating a plurality of 
pixel segments in response to image information 
contained in said first side of said document, 
a first image digitizer for generating digitized pixel 
segment information from said pixel segments 
generated by said camera assembly, 
a first resequencer for expanding each pixel seg- 
ment by adding overscan and underscan pixel 
data to both ends of the pixel segment for avoid- 
ing discontinuities in the image data at pixel seg- 
ment boundaries, the first resequencer further 
comprising means for combining data from adja- 
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cent segments as the overscan and underscan 
pixel data, the means for combining data from 
adjacent segments comprising a plurality of 
buffer groups, each of said buffer groups com- 
prising a segment buffer operable to store data 
corresponding to a first segment of a selected 
column of said first side of said document, a 
segment underscan buffer operable to store a 
portion of the data corresponding to a second 
segment within said selected column -which is 
adjacent to said first segment, and 8 segment 
overscan buffer operable to store a portion of the 
data corresponding to a third segment within 
said selected column which is adjacent to said 
first segment, 
a first image data processor for generating pro- 
cessed information from the expanded pixel seg- 
ments generated by said first resequencer, 
a first transposer/compressor assembly for generat- 
ing transposed and compressed information from 
said processed information from said first image 
data processor, and 
a fust compressed data buffer for storing said trans- 
posed and compressed information generated by 
said first transposer/compressor assembly; and 
(b) a second pipe for processing information con- 
tained on said second side of said document, said 
second pipe including: 

a second camera assembly for generating a plural- 
ity of pixel segments in response to image infor- 
mation contained in said second side of said doc- 
ument, 

a second image digitizer for generating digitized 
pixel segment information from said pixel seg- 
ments generated by said second camera assem- 
bly. 

a second resequencer for expanding each pixel 
segment by adding overscan and underscan data 
to both ends of the pixel segment for avoiding 
discontinuities in the image data at pixel segment 
boundaries, 

a second image processor for generating processed 
information from the expanded pixel segments 
generated by said second resequencer, 
a second transposer/compressor assembly for gen- 
erating transposed and compressed information 
from said processed information from said sec- 
ond image processor, and 
a second compressed data buffer for storing said 
transposed and compressed information gener- 
ated by said second transposer/compressor as- 
sembly. 

2. The pipelined image processor of claim 1, wherein 
said first resequencer further comprises a plurality of 
output registers each of which are operable to receive 
an output of a segment buffer, a segment overscan 
buffer, and segment underscan buffer of a correspond- 
ing one of said buffer groups. 

3. The pipelined image processor of claim 2, wherein 
said first resequencer further comprises: 

a buffer read sequencer operable to sequentially de- 
liver data in said segment buffers, said segment 
■ overscan buffers, and said segment underscan buff- 
ers to said output registers; and 
65 a plurality of multiplexers electrically communicating 
with said output registers operable to sequentially 
output the contents of said output registers to said 
first image processor. 
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, u * (c) means for providing spot and void filtering of said 

4. The pipelined image processor of claim 3 f wherein expanded pixel segments, and 

said first image processor comprises: ( d ) means for scaling said expanded pixel segments. 

5. The pipelined image processor of claim 4, wherein 

(a) means for normalizing expanded pixel segments, 5 said transposer/coropressor assembly is operable to 

(b) means for providing background suppression of transpose said processed information so as to represent 

said columns of said first side of said document as rows, 
said expanded pixel segments, • • • • • 
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